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A. THE PROBLEM 


The problem considered here is the search for the wake 
ef a moving target in discrete time and space. The +azrge+ is 
assumed to move through a finite number cf calls according 
so a known Markov process. The goal is to maximize the 
probability of detection by some specified tine, ee ee 
Beaccher is assumed ts be partially constrained in his 
Motion through the search area, b2ing able to move, in one 
time period, from one cell to a Limited rumber cf ceils in 
close proximity. The searcher is also assumed to have an 'n 
time period wake detector.' The detector is cavable of 
detecting wakes left ina cell by the target up tc nn tine 
periods earli2r. 

The approach taken to. solve th2 problem was ‘+o extend 
The Weechod of T.J. Stewart, {Ref. 1] and S.S. Brown, 
fer. 2]. Stewart addressed searcher employment for *hree 
cases: where the searcher's effort was infinitely divisible 
eeen@rall cells, only! partially divisible, or tctaily indi- 
visible. The three cases corresponi *5 the situation where: 
Sefeewe-  SttaSrt could be divided among ali the possible 
cells during 2ach time period, searcher effort could ccver 
some of the cells during each time period, and searcher 
Meeo=t could only cover one cell during each time period. 
Stewart presented algorithms for finding optimal or near- 
Ogeyeael <solWtions for the first and third cases and 
suggested possible methods for sdlving the second case. 
This thesis generalizes the third case to allow for wake 
Getection;: i.e., the target can be detected at cach *ime 
period in each of several cells through which *he target has 


previously passed in the last n tins periods. 





A major difficulty of the algorithms of Stwart and Brown 
is that they are not guaranteed to produce the optimal solu- 
*:on for reasons which will be liscussed lat 
mates tO always find optimal solutions fer *he indiv 
effort case suggests that this problem might be fundamen- 
Pally ihtractable 

One of the recent advances in computer science is th 
idea of algorithmic complexity and NP- Completeness. 
NP-Completeress refers 95 the inhsrant intractablilityv or 


iD 


Seereenity of a2 problem. Generally, NP-Completeness 
describes a set of problams which have been shown tc be 
Bolyaon] by an efficient algorithm which is run on a non- 
deterministic Turing Machine. An sfficient algorithm is one 
which will scelve a problem in an amount of time proportion 


m a 
*c a polynomial function of the langth of thea input needed 


to describe the problem. Well-known NP-Complet¢ problems 
include traveling salesman voroblems, the knapsack problen, 
and integer programming problems. In Appendix 1a more 


complet? discussion is presented sf ‘the complexity of ths 


4 


1] 


search problem forming tha basis for this thesis. It is 
suspected (but has not been proved) that this se 
is no easier than NP-Complete problems and may b 

Tf so, then the investigation of heuristic or approxima 
solution algorithms is warranted. Fon SUucener 2 

on NP-Completeness refer to [Ref. 3]. 
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II. THE ALGORITHSS USED 


As mentioned sarlier, the algorithms used +o scivs the 
search prcblem were: 1) I.3. Stewart's Constrained Search 
aigorithm (Ref. 1], and 2) Brown's Unconstrained Search 
argorithn, ‘Ref. 2). The Constrained Search Alaorithn 
assumes the searcher is constrained in his motion during the 
search, i1.¢%., ‘the search2r can go from his current cell to 
som2 subset of all the other cells in the grid. The uncon= 
strained searsher algorithm puts n> constraints on searcher 
motion but does assume that the first * search cells are 
fixed and tries t9 optimize the search by choosing the cells 
HO Search fromet+i to Tf. Even in *h2 unconstrained problem, 


search is limited to one cell per tims period. 
A. STEWART'S ALGORITHA 
1. Definition of Symbols 
J = set of all cells in the problen 


jeJ =a particular cell 


mo~~ee= = Metrix Of ali celis in J that the searcher can 


Te@en from cell j (different for sach j J) 
ji = the cell to searched at tine 1 
Gy0rgig-.-, 1t} = @ given search plan 


m(epjey =—awateix of all cells in J searchable at tine *+1 
From cell jt that have not yet been considered in candi- 
date search plans 

Pm=mEPGolapiliaty Of fon-detection E£or “he current bes« 


solution (search plan) 
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Sz 


cell 


jee = Cheenxh search matfix for time’vericd <= wher: 


2 is the cell to be searche] 
a column vector of its 


Logic 


The following algorithm was taken from [Ref. 1]. 

Set +=0, p=1: Select a cell to be searched, j0; set 
K (0, 40) =I (j0). 

Solve the substitute problan (discussed below) for 
search over pveriods t+1, t+2,...,T, with the searcher 
ae Je Prior *o the search, and with search@r location 
miectnices! =St period (2.2. t#1) restrictsd to K(2,jt). 
Obtain thereby (also discuss2d later) a lower bound 5 
on the optimal probability of non-detection when 
Searcher paths are restricted ZO Ghose wepassacg 
macewon {70 , ] 1,.< «, 1t}. 

Mammen, dsto step (6). Othasrwise, it is now proved 
Wacdemall CONntinuations of =h= current path are non- 
Soemlel, 1.6. the arc from (t-1,j32-1) ©€5 (*,j*) is 
fathomed. goto step (4). 

If t=0, the algorithm terminates (all paths from 370 
are fathomed); the current best solution is optimal. 
memo, gots step (5). 
Delete the current jt from K(t-1,jt-1) and set t=t-1. 
ieamKe(e, (ct) 1s Now Smpty,  th=—abe from (t-1,34-1) 0 
(t,jt) is implicitly also fathomed. Thus return to 
step (4). Otherwise, return t9 step (2). 

Select the element of K(t, jt) appearing in the solu- 
sion to the substitute problem and call this jt+1; 
Seum-=t+t. rf t<T set K(t,jt) =1(jt) and return to 
Step (2). If t=T, evaluates the probability of non- 
detection when the searcher path is {30,j1,--.,jT}. 
If this probability is less than 6, then replace 6 by 
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Pius Paliiiovand install (90,51,...,jT} as <he cuszen+ 
best solution. Return to stso (5). 

Essentially the algorithn solves the partis 
constrained problem (unconstrained after time t+1) a 
iomeleco obtain 2 lower bound on the probability oc 
detection for any fully constrained searchers that ha 
Same initial search [(j0,...,jt+1}. The algorithm then trav- 
erses each branch whose lower bound is less than the curren: 
best solution probability. When t=T, the search is row fully 
Cog@-erainecd; and, if its probability of naon-detection 5 is 
less than p, then it is 2 better search plan and is saved. 
When no branches with probabilities less than the current 
best plan are left, the problem is sompleted and the current 
pest plan is sptimal. 

Optimality is Juarantesi if the lower bounds 
Speaane’a Exrom <=hs application of Brown's algerithm ars 
indeed lower bounds. Unfortunately, due to the nature of «he 
problem, (an integer programming problem) +the results of 
Brown's algcrithm are not necessarily lower bounds. A search 
Dlan may exist whose "lowsr bound", trom Brown's algorithm 
is higher ‘*han the current best solution yet whose actual 
PeObability of non-detection for a fully constrained solu- 
tion is lower than the current best solution. Thus the 
Reench containing the optimal sslution may be pruned. 
Therefore, the solution produced by Stewart's alaqorithn 
using Brown's algorithm as a bound will not necessarily be 
optimal. Nevertheless, the solution night be close enough +o 


the optimal for practical problems of interest. 


Stewart's algorithm is essentially a depth-firs+ 
search «hrough a tree of possible soluti 
al 


1 

ns. It uses Brown's 
aagecitnm sO bound the branches ia fe) 
a 


ve *thoss branckes 
r 


wiich do not tontain better solutions 1 the current one. 


Lee 





Miemeceptn-first search strategy gsanerates bounds at ack 
level of the tree and picks the bast bound a+ that level ts 
GontinuS the bounding procedure. In this way it reaches a 
ily Gemseeained search im T ‘Steps as it prsaqres 3 


1 
tion the algorithm progresses bacc up the tres checking 
other branches on the way up. The algorithm s 


has progresseil all the way up to ths top of the tree and has 
poe bownds which are better then the current best solution. 
Another approach is to use a bast-first 


ems “stsvateqy, the best of all ths bounds cu 


i | 
i me | 
iw 
2. 
ct 


lated is chesen as the branch +o futher investiqate. After 
the new bounds are calculated for th2 one step investiga- 
tion, «he best bound is again chosen to investigate. As the 


bes* bound is chosen it is chacked to. see if it oo 
Betion constraints. bE ihe solution does mest + 
constraints then the algorithm stops with the best solutio 
Using the best-first strategy press 
[Ref. 4), Stewart's algorithm was evised and is presented 
below: 

1. Set t=), p=; select jO ts be the initial search 
cell, set K(0, 30) =I (40). 

2. Solve the substitute problams (discussed earlier) for 
Seeipeneover periods t+1,t+2,...,T , with Seareher a*~ 
me up=uom. to the séarch, and with sear@hss location in 
the first period (1.ée. t+1) restricted to K(t,jt). 
Store the lower bound on th optimal orobabil:*y of 
non-detection for each of the elements of K(t,7jt) in 
a priority queue based on the lowsr bound. (ae 
Seome the search {Jo,..., jttl}, the length of the 
constrained part of the search, tc=t+1, and the lower 
beund for each element of K(t,jt)). 

3. Select from the priority quaue the search with the 
smallest lower bound and set the current search tc 

e* 


+hat chosen search. Set t=tc, s$9 
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#. Check the current search to s2e¢ if it mests the move- 
Mentecamatrain=s (i.evewcheckte@io>  fsasdibadie 
feasible, then stop, the curren s 
search. Otherwise, goto step (2). 

Essentially what the best-first search of «he tree 
does is generate bounds for each branch below the -roo0*. 
Then it picks the branch with the best bound *o continue <he 
investigation of the tree. After bounds are generated for 
each branch they are saved on a priority queue from which 
the selection of the best bound is made. 


city gqueus 


#9 stere the 


=~ & = 


A 
(in the implenentation, a priority heap) is used +o mininize 
the time and storage requirements ascessary 
bounds and find the best bound. Then the algorithm picks 
the branch with the best bound to continue the investiaqation 
of the «ree. Once the best bound is found, it is checked toc 
see if it conforms to the movement constraints. If it dces 
conform, the algorithm steps, the optimal solution has been 
Sound. Otherwise, the branches amanating from the branch 
under investigation are bounded andi the algorithm repeats. 
De owe Stith, in [Ref. 4], arqued that the best-first 
starch of most classes of ranion trees has a strictly 
smaller expected time and space complexity. PHeEseoOre, Ts 
was decided to compare the best-first and depth-first trea 
search algorithms for both use of computer *ime and opt:i- 
mality of results. The best-first search, however, is also 


plagued by the possible non-optimality of Brown's alqorithn. 


Be. BROWN'S ALGORITHMS 


TO generate a lower bound on the constrained search 


(iD 


given that the search during ‘time osriods 1,...,t is fixed, 
an algorithm presented by S.S. Brown in {Ref. 2] was used. 
The target position distribution was generated using an 


meee probability density of target location Po and 2 
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Markovian mction model. PO, elie Cange: Lostaadl diszeibu- 
tion, is avector with limension equal to the number of 
G@slis in the spatial grid. Markovian motion is described by 
eee kmwemsiticn BWatrix T that contains the probability of 
moving to cell j given that “he target was in call i. After 
one time period, the new target location density is Poot. 
After two time periods it becomes PoeT2, and after n moves, 
it becomes PoeTn. To implement search in the model, 42 
Seaech matrix $£(1) for time perisi +t was used in the forn 
of a diagonal matrix with the ith diaqonal element given by 
the probability cof a missed detection, and the other diag- 
onal elements equal to unity. Thersfore the vector PoeS1(1) 
contains the probabilities that th target is in each of the 


S=lis and remains undetected after a cne time-unit search in 


e=-ii) 1. We refer to this vector as "the defective targe+ 
location mass at time period 1". PUguLe 2.) tilustsa= os an 
example search problen. Figure 2.2 illustrates a sample 
calculation of PoeS1(1). A four time-unit search in cells 


1, 2, 4, a@nd 3 would yield a defective target location nass, 


Pt(i) given by : 


t (1) =PoeS1(1) eTeS2(2) eTeS3 (4) eT#S4 (3) (2a 


fmessiwal probability of non-detection pnd for the search is 


given by: 


Pnd=Pp+ (ij et] = 0.612 (2.2) 
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oh dle 


The target transition matrix 


SHO eS 0 630. v0 
T= soto4 0 50530 
30 .0 .40 .30 
0 .30 .30 .40 


Gee target initial probability iistribution 
Po= (0.00 0.00 0.00 1.00) 
The searcher motion constraint matrix 
1 2 3 0 0 
1 2 4 0 


0 
1 3 4 0 0 
2 3 4 0 0 
Number of cells is 4 . 
The probability of non-detection is 0.509 
The initial search cell is 1 
An example Search Matrix for a search in cell 1 
Hee. (Oa0 0.0 Oe 0 
S1(1)= Oe0 licn0O7 “0.0 0.0 
Oie0 0.0 1.399 07.0 
0.0 Ono O70 06 


ee a ee eee aS Se 2 ee Ge ee ee eee oe eee eee 


Figure 2.1 Example Search Problem. 


1. Definition of Symbols 


Sj = The search plan chosen after j iteraticns of Brown!' 
algorithn 
Sj(t) = The cell to be searched in time pried t in th 


search plan Sj 


Prd(Sj) = The final probability of non-datection associ 


ated with the search plan Sj 
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0 
Poest(1) = (.00 .00 .00 1.00) 3 


(.00 .00 .00 1.00) 


- 





ee 22 SESS See es ee ee ee i ee eee, 


Figure 2.2 Sample Calculation of PoeS1(1). 


1. Given an initial guess So at a search plan, and given 
a solution tolerance #>0, set *=1, j=1, and $1=So. 

2. Choose Sj (t) tO minimize pni(Sj),(S3(2) iS £4X%6d~ in 
[wes Biniaization for 4+.) The Ménimization is done 
pew Galou lating ni(Sj) for all pose@#blbe choices of 
Sj(*) and choosing the Sj(t) which has the smalles: 
Pnd(Sj). 

a eth, goto step 4. Otherwise, increment t and goto 
step 2. 

4. Cf Prd(Sj-1)-Pnd(Si) <e, stop. Pnd(Sj) is the desired 
bound. Otherwise, increment j, set t=1, set Sj=Sj-, 
amd gets step 2. 

Brown's algorithm is an itarative improvement algqo- 
rithm, where at each time step + the cell which minimizes 
Pond i¢ chosen, given that the rest sf the search before and 
@oeee t zeeunchanged. When the Prd for Sj is within e of the 
Pmdmetoresj-1, the algorithm is t2rainated and search Sj is 
used. 

Brown's algorithm in the totally divisible case, 
where at each time period ¢ the soslution t9 the stationary 
Starch problam is found holding the searches for ‘time 
periods before and after t fixed, will converg2 to the 
optimal sclution as proved in ({Ref. 2}. However, because 
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the implementation here only allows search in one cell 
during each time period the solution Space becomes discon- 
tinuous and thus non-convex. Therefsre, the algorithm is not 


Guiemean=Sed to converge to an optimal solution. 


Brown's algorithm can be considersd ‘to find the 
local optimal solution given a starting solution, So. 
Therefore, the total solution space is partitioned hy 
Brown's algcrithm into those starting solutions which result 
Peers Ope-mal solution (the global optimum) and these 
Starting solutions which result in non-optimal solutions 
(local but not global optimums.) Based on this partitioning 
idea several alternatives are availabl;. 

Mie ESE St is to choose a good Starting seclution. TI£ 
the optimal solution were used as the starting soluticn, 
Brown's algorithm would always arrive at the optimal solu- 
tion. However, <=he optimal solution is not known, otherwise 
Brown's algorithm would b2 unnecessary. Two approach2s were 
used to guess a good starting solution: 1) the myopic solu- 
a2 0n , So(t) is chosen +o give th mest improvement <+o 
Prd(So); and 2) a random solution, 2 random number generator 
is used +o cenerate random starting solutions. 

As mentioned in [{Raf. 2], if 2 zero solution is used 
*o star* Brown's algorithm then tha myopic solution will 
result after the first iteration. Th2 myopic solution seems 
like a reasonable choice to start the algorithm. On the 
other hand, there might be some negative correlation be«ween 
Bae OD-:@el solution and the myopic solution, i.e. the 
myopic solution may li2 in anoth2r partion which does nox 
ieacdetoth] optimal solution. Therefore the random stazting 
solution was also considered as 4 means to qst around any 
possible negative correlation. Since the random solution has 
MP einice probability of choosing th2 optimal soiution it may 


Naver a better chance of starting in the right partition. 
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Ano*h2r approach used was to restar* Brown's algo- 


Ss 
rithm any time a change was mad to the currant solution. 
The revised algorithm is presented below: 
1. Given an initial guess So at as 
jJ=1, and s1l=Sc. 
2. Choose $1(t) to minimize Pnd(Sj),(S1(i) is fixed in 
2S Mavi Zation for i#t:) The Pinimization is done 
Dy calculating Pnd(S1) for all possible choices of 
S7i(t) and choosing the S1(t) which has the smalles+ 
Pnd(S1). 
eee > WE FESO (OO) then set So(t) =S1(*) and goto steo 1. 
nue <-T, gieto step 5. Otherwise, increment * and gots 
Soep 2. 
Pee oeoOp. Pnd(S1) is the desired bound. 

This variation of Brown's algorithm takss an initia 
Meredicaon and starts at the first tim2a period checking for 
Beealeoptimelity for that time period. Lf *he choice of cell 
to be searched az the currant time osriod is locally optinal 
Bot uMat tiwe period then the algorithm goes on to the next 
time period. Jtherwise, the algorithm inserts *h new search 
cell and starts back at the first time period. When the 
algorithm goes all the way through the solution without 
changes it stops. This appreach may repartition *he solu- 
tion space increasing the size of the partition which leads 
E> the optzmal solution. 

Another appreach which was not used is +o run the 
algorizthm several ‘times with different starting solutions 
So. Then the lower bound can be taken as the minimum of «he 
locally optimal solutions returned by the algorithn. Also, 


the lower bound can be astimated by 


est=(P95eP5-P32.52) / (P95+P5-20P32.5). (2.3) 


20 





a a 


Meo ana P32.5 are the STH, 95TH and 32.5TH percentile 
values. This estimate is based on the idea that, as the 
number of independent solutions produced by 2 qiven algo- 
rithm for agiven problem increase, the solucion valuas 
converge to a Weibull distribution whare the optimal lower 
bound is the location parameter. This approach was not used 
because i+ required running Brown's algorithm two or more 
times to calcalats each bound and it was felt that “he addi- 
tional computer cime would not improve the bounding process 
eeoie c2cantly. 

A final appreach which also was not inves«igated, is 
Pombocally optimize thea choice of calls over 2, 
Sen periods in the Brown algorithm. This again mign* 
increase the size of the partition which leads ‘to «he 
Sottm@al solution. 
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A. BACKGROUND 


As mentioned earlier, this thesis 


extend existing optimal search ‘theory 


problem of wake detection. Stewart's 


e 
5 apn 
+ < 


“hms, es presented in the last 


method for solving the constrainsd 


next question iss "How doses one 2@xtend 


Rendle the possibility of wake detactioan?' 
See 


Stewart's algorithm joes no 


probebe lity of non-detection, 
erewcamcula*ion of bounds. 


JS 


th2 one =hat aeeds to be altared 


detector. To extend the algorithn 


Chapt 


Searcher 


al calculate on 


alVowertio=t use of a 


proceed as 


=o 


+ho 


1S an attempt 
techniqnes *0 
Brown's 


and algo- 


hiecaso. sone 
The 


al Gomecchms =o 


205 5 
probien. 
*h2 


of thie 


Brown's algonathm for 


BeOwWh ’S algoriechmn 2s 


wake 


follows: 


B. DEFINITION OF SYMBOLS 
Pame=meene ial target probability distribution (i.e., the 
Deomantlaty that the target is in any cell = at the stazt 


of the probien.) 


iS 


—_- ww 


1-P (4) 
The defective probability 


St(i) = an nxn matrix which 


ability mass of the target by 


deo 
- @ 


at time 
cells remains unchanged. 


a Markov transition 


prope=bility that a target in cell i 


a. inn 
at 


matrix which 


duces the defective prob- 


“n cell i searched 


mass of «he other 


contains «the 


= 


- 


ime period * will 


@eensition to cell j at time period t+ti. 


anxit column vector of t's. 


‘oe 
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e GOGEIC 


What needs to be extended is the nodel under which «he 


non-detection probability is calculated. As, Shown Satlier, 
this calculation for a non-wake datactor ina 4d time unit 
Soaach is 

Pnd=Po eSteTeS2eTeS 3eTeSte 1], (3.1) 


It is new proposed +o allow the searcher *o carry an 


W 
Mieco bm Unit wake detector.’ This Jatector has the capa- 
bility of detecting wakes in the cell being searched which 
were made by the target up to n tine periods sarlier. TS 
extend the moiel to handle ‘'n-time unit wake detectors! two 
assumptions are made. 

Pirst, it is assumed that each wak2 search for each time 
period is independent of all other searches. For example, 


a 
when a searcher searchs ceil 2 at time perisd 3 with a 2 


7 


& 


2 unit wake detector hs is completing thr2s separate and 


}+- 


im 

moe pendent searches. The first is sf cell 2 looking for the 
wake made by the target during time perisd 3, the seco 

of cell 2 looking for the wake made during «ime period 2, 
and the third is of cell 2 looking for the wak2 made du 
time period 1. Note the search2r has also completed 3 
search during time periods 2 looking for wakes made during 
time pericds 1 and 2, and a search during *+ime 22 da 
looking for wakes made during +ime period 1. Therefore, in a 
3 time perioi search with a two time perisd det 

searcher has made a total of 6 independent searc 
cells, the cells he chos> +o search at time periods 1, 2, 
an@ 3. 


Also note that the target is assumed not to have lett a 
Bewecs2o> +O ths start of the problem for 2as2 of cenputer 
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Galcude*+ion and formulation of the problem. This does nr 
restrict the result. 


O 
at 


mee second assiimption iS that we are trying +o calculate 
ene probability of non-detection after the specified length 
of search 1s completed. We are not trying +9 2valuate the 
probability cf non-detection at intermediete points in *he 
search. 

Based on those two assumptions, the wake detection 
concept can b2 considered a Simultaneous search of «the cell 
the searcher is in now, the cell th2 séarcher will be in 
next time period, *th2 ceil the searcher will b2 in two +ime 
periods from now, etc., out to the maximum nunbsr of «ime 
periods the wake is detectable or t9 the number of time 
pericds remaining in the problem, waichever is smaller. The 
wake search is modeled as if an equivalent search is 
conducted simultaneously with the real-time search, ieee 
Searching for a wake in call j whith is t time periods o13 
is equivalent to searching in call j, t+ time eriods 
previous, Simultaneously with tha other searches being 
conducted t time periods previous and waiting + time periods 
*o discover the results of the search. 

As shewn previously, the probabilit of non-detection 
for the search without waka detection can be calculated fron 
the product of a series 9f matricies as shown in equation 
Beli For a search in the same calls but with a one time 


mee wake’ detector, the probability of non-de*ection is 


Pnd=P00eS10S2eT eS 2eS3eTeS3 eSh4eToShel }j. (3.2) 


The vector Po, as defined earlier, is *he probability 
Bio eenomeeegoe is in c@ll 2 am trey start of Whe problen. 
Thea vector PoeS1 is the probability the targe* was in cell i 


at time period 1 and has not been detectsd by the wake 
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seamen conducted during time period 1 looking for a wake 
left in time perisd 1. The vector PoeSieS2 is «he prob- 
ability «the target was in cell i at time period 1 and has 
not been detected by wake searches during time periods 1 and 
2 looking for wakes created in tina period 1. The vector 
PoeSteS2eT :s then the probability «hat ‘the «arget is in 
cell i at +ine period 2 and has not been dete by wake 


czed 
searches locking for wakes created jiuring time period 1. 

Followir +he same line of reasoning, =h 

+ 


PoeSteS2eTeS2eS3eTeS3eS4 is the probability that 


is in cell i at time period 3 and has not been detected by 


wake searches Looking for wakes created during time pericd 3 
and prior. Of note is tha idea that the searcher in effect 
conducts simultaneous searches of 2 cells during a giver 


time period but dees not receive the results of the ons time 
unit wake search until the next tim? period. 

The wak= detection problem is analagous =o ‘the problen 
where a homeowner thinks there are mice in his house and he 
Peace CONS =m his sSslscpicions. Each room af the nouse has 
two tape recorders: one which is 2vailable for replay of 


what noises were recorded in «he pr2vious hour and the other 


which is recording the current hour. The owner can cnly qo 
Gomadyecent roems which have doors t> the current room. He 
Sgemds one hour in the rd0m of his choice listening fer 


mice. Once in a room h2 can listen for mice and at the same 
time listen t> the tape recording of the previous hour. The 
probability of detecting the mice on the tape recorder or by 
listening in a room is the same. The owner now must decid? 
how to search the house tO maximize his chances of finding 
the mice. 

The tape recordings of the nois? in each room are esen- 
tially independent and simultancous S2arches of each room in 
the house. The owner can only determine the results of the 
search by tape recorder if he enters the room and listens toa 


iL) 
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ape recorder. TE Senewoumer do]\sn't tisesn “0 the tapa 

recorder during the hour the second racorder is «aping «he 

om, the first recorder is rewound and starts taping “hus 
destroying the results of that particular search. 

2 key assumptions, as stat2i earlier, are that the 
searches ar¢ independent and that ths goal is to minimiz2 
the probability of non-detection over a given search lencth. 
Meesetcre the wmatrix multiplication in equation 3.2 is 
valid. Hosea twO time unit detector, ho 


non-det2ction is 


Pnd=PoeSteS2eS 3eTeS2eS3seShoeTeSsesteTeSihe j. (363) 
Mie BAtTIixX multiplication san be e2xtended for a Tl capecity 
wake detector where Tl is the time late a searcher can enter 


ey Gell anc still detect the target's wake. dooms iat AU AL 


capacity detector equation 3.2 becomes 


Pnd=PoeST leTeST2eTeST3eTeSTde,..eSTmaxel j. (3.4) 


an(l wax, itll) ; 
Si? = I Sc ()) CE Arey 
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IV. RESOLTS 


— = Se aa ae 


A. DESCRIPTION OF THE COMPUTER PROSRAN 


The algorithms presented in th2 preceding chapters wers 
implemented on the U.S. Naval Postgraduate School's IBM 3033 
computer system in Fortran H (extanied). Th2 program was 
Sempeccucted of A Main driver program which called various 
S@oLeurines for input, calculation and output. 

The operation of th? program can be breken down into 
Pain functions: 1) generation of the problem including “he 


* 


n 
Pavel target distribution, the transition matrix and ths 
searcher tovenent constraint matrix; and 2) ssluticn of 
generated problen. 

The generation of the problem used two methods. Piene 
method the probleén generated was a deterministic one where 
+he target's initial position was at the far corner away 
Eom the searcher who started in call 1. Tha targe" tran- 
Sition matrix was generated assuming that tha target had 3 
Pezed probability of staying in the call it currently occu- 
pied and the remaining probability of movement was divided 
evenly among the c2lls which were aijacen*. Diagonal move- 
ment was not allowed. Figur? 4.1 shows a example initial 
Pardee distribution and *arqet transition matrix for ths 
deterministic case. The s2archer movenent constraint matrix 
was generated by allowing the searcher +o move only from ths 
current cell to an adjacent cell. 

In the second method, the problem was randomly gener- 
ated. The target was randomly distributed between all the 
cells at the start. The target transition ma«rix was gener- 
ated assuming a fixed vrobabilit of remaining in the 
current cell and then the remaining probability cf movement 
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Figure 4.1 Exaaple Detarministically Generated Problem. 


was randomly distributed among the adjacent cells. The 


searcher movement Geonetraint hatci<x was determined as 





Po=( 0.23 0.34 Q. 


= 
cei eter eee 


hee <n 


J 

| 

| 

| 

| 
CS 


Figure 4.2 Example Randomly Generated Problen. 


before. Pigure 4.2 illustrates a typical tandom preblen. 
Figure 4.3 shows the program structure and subroutines used 
to generate the deterministic and ctandom problems. The 
program requires 6 inputs as defined below: 

eceezee Or Che grid 1.2. 3x3, 4x4, etc. 

Pee esobability of detection sf the target if the 
searcher and target are in th2 same cell. Also used 
as the probability of detection of the target using 
the wake detector. 

Seer ecspto bability st {he target staying in the cell 


Beecurlrenpey Ocetpies. (2.2. Til) 
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Pigur2 4.3 Problem Generation Subroutines. 
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6. 


fond 


mentioned earlier. Seven algorictha 


Whether the generated problem is to oe deterministic 
95 raniom. 
Epsilon, Weed aS) auseoeraag Crlte=ia for Brown's 
algorithm. 
The capability of the wake idatector, (1.2. how many 
time units late will the detector detect a wake.) 


the cptimal solution using h2 various algorithns 


c 
Once the problem was ganerated it was then necessary to 

t 

Ss 


wera used «zc find the 


solution: 


i 


oes 


Depth-First search using the myopic solution to start 
Brown's algorithm. 

Depth-Pirst search using a randomly chosé¢n solution 
*o start Brown's algorithn. 

Depth-FPirst search using a random solution to start 
Brewn's algorithm and using the modification which 
restarted Brown's algorithn every time the solution 
was changed. 

Best-First search using the myopic solution to star+ 
Beewn'’s algorithms 

Best-First search using a randomly chosen solution to 
start Brown's algorithn. 

Best-First search using a random sclution te start 
Brown's algorithm and using the modification which 
restarted Brown's algorithm every tine the solution 
was changed. 

Total enumeration of all possible search solutions to 
determine the on@ with th2 lowest probability of 


nonw-detection. 


The only algorithm guaranteei to produce the optimal 


sclution was the total anumeration algorithm which genera+ed 


auld 


Peogeem Sunucture and subroutines necessary =o implement ¢t 


pessible feasible solutions. Pigure 4.4 shows the 
h 


algorithms andi problem soluticn part of the orogran. 
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Figure 4.4 Program Solution Subroutines. 
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The output generated by the program included: 
1. cpu seconds used by each algorithm 
2. number 9f unconstrained solutions checked 
3. number of constrained solutions checked 
ies probability of detection of the tamget after search 
5- search plan used 
Figure 4.5 presents an example program output. 


| THE TARGED TRANSITION MATRIX 
240 130 .30 .0 
| 530 140 .0 .30 
«30 m0) a0 -30 
{ Pe 0, 3.0 a) 40 
| THE TARGE? INITIAL PROBABILITY DISTRIBUTION 
G0. 060 G0 1.00 
| THE SEARCHER MOTION CONSTRAINT MATRIX 
ie Dales gO 
7) a 
——— “0 0 
| eee. Be 0 0 
NUMBER OF CELLS IS 4 
| THE PROBABILITY OF NON-DETECTION IS 0.500 
| eae Wire SEARCH CELL IS 0 
THE ALGORITHMS USED ARE: 
| J > DERTH FIRST STRATEGY, WyopI= INITIAL SEARCH 
2 - DEPTH PIRST STRATESY, RANDOM INITIAL SEARCH 
| 3 - DEPTH FIRST STRATEGY, RESTART AFTER EACH CHANGE 
| 4 - BEST EIRST STRATESY, MYOPIC INITIAL SEARCH 
5 - BEST FIRST STRATEGY, RANDOM INITIAL SEARCH 
| 6 - BEST PIRST STRATESY, RESTART AFTER EACH CHANGE 
{ 7 - @CEAL ENUMER ATION 
SFARCH PLANS FOR TMAK= 4 AND TL= 9 
ALG IrLAE #0 NC #CON P (D) SEARCH PLAN 
| 1 002 6 3 0.3900 12 4 4 
2 0°01 6 2 Go s60e a a a 
3 0.02 6 3 0.3900 12 4 4 
mn o0l2 3 . 0.3900 1 2 4 4 
| 5 2) 2 3 0 0.3900 12 4 4 
6 3.01 3 OME OC OM t2 4 a4 
7 0.01 0 27eomsso00 12 «4 & 


Figure 4.5 Example Program Output. 
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Werng the program described above, grid sizes of 4, 39, 

16, and 25 cells were investigatsi. All s¢ven algorithms 

were tested on deterministic problems with Tmax=2,...,10 and 

PSO, 1,2. While the problem sizes considered are not large 

enough for real life problems it was felt that they were 

large enough *9 demonstrate the algorithms. The results can 

then be extrapolated to determine axpected running times for 
real life problems. The goal was *9 answer two questions: 

1. How close to the optimal area the solutions from the 

pbranch-and-bound algorithms? 
2. How do the running times of the algorithms ccmpare; 
to each other, and to he total enumeration algo- 


= hem 2 


Be OPTIMALITY OF THE ALGORITHM OUIPOT 


As mentioned earlier, the problems under consideration 
SBernged from a 4 cell grid with MTmax=2 and T1l=0 to a 25 cell 
grid with Tmax=10 and Tl=2. PicweScale NUnbes Of poss: ble 
ComstGesred sdlutions tanged frome3 to 275905. Table I shoes 
+he number of non-optimal solutions and the maximum percen® 
difference between the optimal and non-optimal solutions for 
each of the algerithms. Sinc2 the problems were symmetric 
there were several optinal Sour Ons, sc the 
branch-and-bound solution could b2? an equivalent althoudh 
different solution from the total 2nmeration solution. This 
may have increased the probability sf the branch-and-bound 
algorithms finding the optimal solution. Further investiga- 
tion into larger random problems nay yield more non-optimal 
solutions and larger percent differences, however, fully 36% 
cf Stewart's results, as reported in (Ref. 1], were optimal 
with the non-optimal results being within .41% of the 
optimal solution. Therefore, the results of this run tend to 
confirm Stewart's results Soneeornamg she Optimality of the 


branch-and-bound algorithm solutions. 


33 





a a a a eh ED A cell 


| 


TABLE I 
Non-Optimal Solutions 


! 
| , 
Algorithms 
| 1 2 3 4 
Number 
| eek OF—optime 2 0 9 2 
emus LOns 
Maximum percent ~04% 0% 0% ~O4% .91% 0% 
| n= cot 
ee ee 


C. RUN TIME COMPARISON OF THE ALGORITHMS 


Since all the algorithms seem 45 be abie to find the 
optimal of near-optimal solution without too much dif fi- 
ity. 2st is now important to 
(Wile sre + 


datermine which algorithn 

fa Ss 2 

was used to provide a benchmark fsr the optimality of the 
ir b 


performs the <al enumeration alcerithna 
solutions i+ can also serve as a 
of the algorithms. 

The runniiag time of the total enumeration algorithm is a 
function of the number of possible feasible solutions. The 
number of feasible sclutions is based on how many places the 
Searcher can jo from the cell he currently occupies. From 
each cell the searcher can transition to between 3 and 5 
cells. If the searcher 1s in a corner cell he can stay where 
he is or transition to either of ths «wo cells which border 
the cell he is in. If the searcher is in a side cell he can 
stay where he 1s or transition to any of the three border 
sells. If tne searcher is in an interior cell he can again 


Soay sameme she Iseot transitiom +9 any of the four border 


Tmax 


cells. Therefore the total number of feasible solutions is 
bounded below by the exponential function 3 , where Tmax 
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is the length of the search. The number of feasible 
tons is bounded above by the exponential function 
5 - Since the total enumeration algorithm looks cnly the 
feasible solutions and calculates Pnd for each one «he algo- 
rithm is therefore O(e ail or of 2xponential complexicy. 

The branch-and-bound algorithms don't lend themselves to 
Such easy analysis. The worst cass analysis would be whers 
*he bounds are so weak that all the feasible soluticns would 
have to be checked. The average cas? analysis is much nore 
Seeececa lt. Smith infRef. &@], arguel that the bes+-first 
strategy hada smaller average cas@ complexity than «he 
depth-first strategy. Since it is unclear whather the *rees 
generated by the search problem fit into the class of random 
trees covered by Smith's argument, further complexity anal- 
ysis will not be attemptei. 

Appendix 8 contains graphs cf the run-“*ime for ail seven 
algorithms for all the cases. Frode che dlaons it is clears 
that the best-first strategy did satperform the depth-firs* 
Strategy especially as the problen (as measured by the 
number of possible feasible solutions) increased in diffi- 
cul*«y. This is supported by analyzing the number cf solu- 
moms cniecked by Sach algorithsm. Table II shows the number 
Se Solwztions shecked by each algorithm for the 25 cell grid 
weet? T1l=2. 

From cable IF it appears that until time perio 
algorithms looked at all the possible solutions. Since *he 
total enumeration algorithm didn't look at any interme 
= 


Solutions it was faster. After time period 6 the 
branch-arnd-boind algorithms where able to use *he pruning 
feature to a great extent in removing unpromising branches. 


Table ITI shows the runtimes reeded *o used in 
maa SOrue2Ons in table II. Based on the number of solutions 
c2lculated by each algorithm it appears that the bes 


S eateay 15 MOr2s efficient. Sine> the best-first strateqy 
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TABLE II 
Number of solutions for 25 Cell Grid, f1l=2 


PARTIALLY CONSTRAINED SOLUTIONS 
(Brown's Algorithm Output) 


eee SSE et EE Loam, Ecce “SI ce cee SE SC — oe | 


| 
| 
| o 
| Algorithm 
{ Tmax 1 2 3 4 5 6 7 
2 0 0 0 e) 0 0 0 
| S 3 3 3 3 3 3 0 
4 14 14 14 14 14 14 0 
| 5 57 57 57 ST S7 SJ 0 
6 234 234 234 234 234 234 0 
| 7 9:83 983 938'3 983 983 983 0 
8 ANNO? seuwo2 ~1123 91123 #1723 0 
| 9 S52 4215 2309 1573 18593 1598 0 
10 2787 4066 4532 1375 1359 1383 0 ! 
| Totals 10182 115971 10534 5362 5366 5395 0 
| 
| CONSTRAINED SOLUIIONS : 
| Algorithm { 
Tmax 1 2 g ub 5 6 7 
| 2 3 S 3 3 3 2 3) | 
3 11 A. 11 11 11 14 11 | 
| 4 43 43 4 3 43 43 43 43 \ 
5 177 177 1 WF 177 177 Way | 
6 749 749 749 749 749 TH9 T49 
1 9 16 563 386 100 100 100 5 248) 8 | 
| 8 W273 987 1439 2 0 0 14139 { 
9 60a 1552 1228 160 160 N60 62302 
10 246 ot 765 J 0 Jao l05 
| TC tas 4019 4336 4296 1243 1243 +4243 #356571 
La, os 


algorithms hai almost exactly the same number of solution 
Ccalculaticns whereas the depth-first strategy algorithms 


ere more divergent it cculd be hypothesied that «he best- 


x 


first strategy is more tolerant of the non-optimal bounds 
produced by Brown's algorithna. 

Table IV shows how the number of solutions varied for 
all the cases where Tmax=10 (1.¢. whare the maximum number 


of possible feasible solutions was 1ste2d.) 
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TRSLE IIl 
Algorithm Runtimes for 25 cell Grid, Tl=2 


| 
| 
| , 
Algorithn 
| Tmax 1 2 3 4 5 6 7 
2 D0 0.0 9.0 0.0 O70 0.0 0.0 
3 D2 O52 Os JZ DerZ or, 9.0 
4 Woe ez OSS Ngee LS Og Osa 
5 Sas. Bio a. ae./ 6.4 4.6 os 
6 261.5 a. 8 BAAS ME Pe 2123 2a. 2 1.8 
7 A123 deus. 3 So. 100.9 113.5 S77. 0 oe 
8 2250.4 32.6 30850 2U0.9 253.3 278.3 48.2 
9 O2i.4 BBs. 2 geod s oe OST. «654765 74326 208.7 
10 izes. 4 15900.39225 2.0" 843.0) 845270 109% .1 1289.1 
Moats 2552.2 2865.2 3510.9 1755.0 1794.4 2632.1 1556.9 
runtime in cpu seconds 


be ee eee ae OD eee ee AE eet A te, SD ee OOS ces BE) I Sa OME TT d 


_ 
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Table V tabulates tha running tima required to generate 
the solutions for the casas where [nax=10. Prom the tables 
it can be sean *hat «he best-first strategy dominated «he 
depth-first strategy, mainly becaus>= it had =o look a+ fawer 
solutions. Also it can be seen that the restart algorithm 
was not competitive when Imax=10 for any of «he cases. This 
reflects the fact that it must restart after every change in 
#+he current solution and as Tmax increases the number of 
changes also increases. Therefore the restart algorithm is 
forced to restart significantly nore frequently and thus 
takeee longer to arrive at the local bound. From table IV it 
is seen that the axtra time taken £5 calculate the bound did 
not reduce the number of solutions which were invesigated. 

Z= 2S apeperant hat the best-éirst strategy, using 
either the myspic or random starting solution, performed 

y well when compared t> any of the other algorithms. As 


expected, <h2 runtime for the total enumeration algorithno 
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All Cases 


TABLE IV 


Namber of Solutions for Tmax=10, 
(Brown's Algoritha Output) 


PARI IALLY CONSTRAINED SOLUTIONS 


Algorithms 
4 5 


3 





Orn 


Onn 


Orn 


US 


Deen E OSs 3 


6988 


1sea7 15605" 1355 
TOTALLY CONSTRAINED SOLUTIONS 


5 


Sgt en 


3 


Oren 


Oe N 


OOo 


DOO 


Oern 


ooo 


OOO 


282 1963434 


2368 240 255 


2762 


3425 


Totals 


ES SL EE ee ee ge Ee ee qe EE ne SE ee er ee ee ee ee ee ee ee ee ee 


and it appears, 


The 


exponentially. 


t 


increased rapidly, 


qd) 
4 


algorithms 


depth-firs 


the 


all 


hms, 
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TABLE V 
Algorithm Runtime for Tmax=10, All Cases 


a Ee oe eee oe eee SE) ee 


| 
Gead TI Algorithms 
Size 1 Z 3 4 5 6 a 
| 0 4.3 4.4 Sigil, 4.1 S120 320 10.4 
4 1 09.4 0.4 0.7 0.4 0.4 0.6 Volek 
| 2 Oey 0.4 lena OE 0.6 Ors 159 
| Q 129 16.1 18.8 10.4 Siar liecoume 1 5.0275. 4 
9 1 W.7 10.6 19.7 8.8 69 en Cas a ae 
| 2 4.3 Siar Zoe 3 1029 9.0 i GP (eile so as. | 
o 12008 Sets ome 113.7 . 10450). 212.7 672.9 1 
| 16 ewe tee 225 119. 2) 148.9 «| 220.4. 671.9 | 
| Bese tes se8 Ssagml5o6.4 125.4 250.2 674.8 | 
| OeeOG 1 ONmow oO. 20102 8.605619 597.8 1094..6.1249.3 | 
Z5 fiero 102.0 1277.3 9709.8 696.9 1262.0 1244.5 | 
| Zeizes. & 1500.3 2252.8 B43.0 885.0 1494.1 1249.1 ! 
| Meee ys) 3509.3 3734.9 5359.2 2538.9 2461.8 4588.7 6250.9 | 
runtime in cpu seconds 


best-first restart algorithm, tendsi tos be somewhere between 
+he two extremes. In the final cass, where Tmax=10 and 
Tli=2, the total enumeration algoritha was still competitive. 
It is anticioated that as Tmax is increased beyond 10 the 
total enumeration algorithm will surpass all the other algo- 
rithms in runtime requirei. 

Based on this exampl?, it appsars that the best-first 
strategy with either the myopic or random starting solution 
2s preferred. Further examples might indica+2 a preference 
between the myopic and random starting solutions. 
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V. EXTENSIONS 


A. PD AS A FUNCTION OF WAKE AGE 


The program as currently written, assumes that “he prob- 
ability of detection of the wake is constant with the age of 
the wake. In reality, one would 2xpsct the orohahility of 
detection to decrease as the wake age increased. This would 
relatively simple to implement. What would be needed would 
be ¢ither a separate probability of detection as the wake 
aged or a functional relationship between wake age and prob- 
ability of datection. The progran would then have +9 be 
mcdified to use the appropriate probability for the various 


search matricies, St(i). 


Be COUNTER-DETECTION 


Another aspect of interest 1s the idea of counter-detection 
of the searcher by the target. It could be speculated that 
1£ the «arget detected the searcher when they were both in 
+he same cell at the same time, the search would be blown 
and therefore any target probability mass which detected the 
sStarcher could be removed from the problem. One way of 
accomplishing this would be to have an added cell to the 
grid. The searcher would be unable to search this c2ll and 
the target once in the added cell would never transition 
out. Then two search matricies would have ¢o be used. The 
Modified search matrix St* would includs a probability of 
counter-detesction anda transition of that target prob- 
ability mass which counter-detectad into the extra cell. 
The search matrix St for the wake search would remain 
unchanged. Figure 5.1 illustrates the probiem input, 
ipeeetal probability distribution, target transition matriz, 


and example search matricies. 
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The target transition matrix 
040 .30 a0) 


-30 .0 
T= —o0 2.t0 2.0 5.30 .0 
30 .0 .40 .30 .0 
a0) 30.50 240.0 
BO sO rs 0 1.0 


(ree -Grget initial probability distribution 
PO= 0.00 0.00 0.00 1.00 0.00 
The Searcher moticn constraint m2ztrix 


1 2 S ) 0 
1 2 - 0 0 
1 3 = 0) Q 
Z 3 uy 0 0 
s) 0 0 0 0 


The probability cf non-detection is 0.500 
The probability cf counter-detaction is 9.200 


Example Search Matricies for a search in cell 1 


oo Wake Saarch Matrix 
a2 0.0 9.0 0.0 0.0 
573 1.00 Q.0 0.0 0.0 
Seat) = SO OO SO A0O «68 GE0. «6 C0. 0 
0.0 0.0 0.0 1.00 90.90 
0.0 0.0 0.0 0.0 1.00 
Modified Real-Tim2 Search Matrix 
05.505 “0220 0.0 0.0 0.20 
0.0 1.00 0.0 0.0 0. 
S1'()= 0.0 0.0 1.00 0.0 0.0 
0-0 0.0 90.0 1.00 0.0 
0.0 0.0 0.0 0.0 1.00 


O 


| Se rY ce mmm rr re cr Dc I ee ee ES nee Se rae SS ee a ey Si ey SS es By a ce ey ee 


Pnd for a 4 *ime unit Search with 2 2 time unit detect 
Pnd=PoeStleS2eS3ZeTeS2teS3seSheoTeS3st eSheTash tet} 


eg Ee eee ee 


i 


Figure 5.1 Search Problem Modified for Counter-Detection. 
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C. APPROXIMATIONS TO THE OPTIMAL SOLUTION 


momeccal tif oroblems on the or@er of 25225 grids and 
larger with Tnax250 and T125, the computer time to reach 3 
close approximation of the optimal ssluticn nay be ex 
siv2. Therefore, Stewart in [Ref. 1] suggested using the 
first feasible solution that aros= from the depth first 
Search. The first solution could be viewed as 2a form of ths 
myopic search. The optimality characteristics of such a 
solution have aot been subjectsd to worst cas? or avetags 


case analysis. 
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VI. CONCLUSIONS 


A. PROBLEM COMPLEXITY 


Mention has been made of the apparently fundamental 
intractability of the discrete tima and space moving target 
constrained searcher problem. Earlier it was conjectured 
that the problem is at least NP-Complete and possibls 
NP-Hard. Appendix A discussed the complexity of the problem 
and provides some justification for the conjecture. 

If the conjecture is true then the implications are 
clear. Conventional attempts at trying to find ‘atficient'! 
algorithms are doomed to failur:, particularily if the 
problem is NP-Hard. Thus heuristic algorithms are the most 
fruitful avenue Lor  fotaing Sptimal or near-optinal 
solutions. 


B. CHOICE OF AN ALGORITHM 


tees “yOpte Starting solution for Brown's algorithm 
combined with the best-first strategy oroduces «he best 
results. This combination was consistently better than «he 
total enumeration algorithm and, as the problem became more 
difficult, vercformed better than the other five variaticns. 

The solutions to the constrained ssarcher problem 
(Stewer="s algorithm output) were compared for both opti- 
mality and runtime. However, th2 solutions t> ‘the uncon- 
Strained searcher (Brown's algorithm output) were not 
compared except indirectly as the sutput affected Stewart's 
algoritha. There may be Significant differences in the 
bounds provided by the different variations of Brown's algo- 
rithm. It did appear that the restart approach was signifi- 
cantly slower as Imax increased. This had a significant 
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cate cr on the performance of Stewart's algorithm. As Tmax 
increased the restart approach besams increasingly slow 
than the myopic or random approaches and the difference 
could not be explained by a chang2 in the number of solu- 
tione which had to be calculated. Thus even if the onti- 
Melity of the bounds produced by the restart apprcach was 
improved over the other approaches, it was overshadowed by 
the increased time required. It is sonjectured that the sams 
effect would sccur if the estimation sechnique were used. 

There are several altarnative ways +9 approach «he solu- 
tion of the constrained searcher problem. As shown by 
Stewart in [Ref. 1], the idea of network flows could he 
applied. Also, J.N. Eagle in {Ref. 6] proved that a dynamic 
programming approach was guaranteed ‘*o provid2 an optinal 
solution for the nen-wake search constrained searcher 
problen. Either of the above approaches may be extendable 
to the wake search case. 


C. WAKE SEARCH 


The ex*ension of th2 constrained searcher oreblem +o 
dal with wakes rested on two assumptions: 1) the indéepen- 
dence of the searches anid 2) th2 goal of 
Begoan tility of non-detecticon for a £Eix2ed tin 
Tha first assumption may not in fact be valid 
conditions. To say that two search2s have independent prob- 
abilities of detecting a target when the searches are 
constrained to use the sam2= search path might b= incorrect. 

For example, suppose that at time period i the target 
moved from North to South in cell j. Also suppose “hat in 
time period i+2 the target moved from East +o West in the 
same cell j. Now the searcher anters the cell at time 
period i¢4 with a5 time unit wake detector. If the searcher 


ses a search plan that searches from East +5 West in an 


= 


ay 





exhaustive fashion he has several chances and thus a high 


a 
i 
ie | 


probability of detecting the tine period i wake than «he 
time it2 wake. Conversly if the searcher uses an exhaustive 
scatch path from North to South he will have several ch 

to detect the wake from time period it2. Therefore it o 
an oversinplification to assume that the wake s 
all independent of each other. The assumption did mak 
Ccalculaticns possible and therefora even if *he assumptions 


stretches the truth it will still yield answers cf interest. 
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DISCUSSION OF THE COMPLEXITY OF THE SEARCH PROBLEM 

Mmoechs aopierdam, I hope to May the foundation for the 
determination of the complexity of th2 wake search problem. 
The problem will be approached in two ways: 

1. Show a restricted version »9f the constrained wake 
search problem is an element of ND. 

2. Show that the unconstrained wake search preblem is 
functionally similar to the Knapsack Problam which 
has been shown to be NP-Completa. 

As defined in {Ref. 3], a problem is in NP if a tenta- 

ve solution can be written down and check2d in time poly- 
m@Gmeal =n *eh> size of the oproblem input. The wake search 
problem can b2 formulated as follows: 

Musto es Ein te set J={yl,j2,e*«.,}n} Of cells Which can 
Boe aesened, 2 probability PO=f{p1l,p2,...,pn}, IS01is1 for all 
3=1,N that the target will start *he problem in each cell, a 
Peobaollity Tij, OSTVa<tetor Sal) L=1,N, j=1,N that the 
target will move from cell ito cell j, a bound B20, and the 
Pwo tat) for Sich ji, a subset 5 J containing the cells 
reachable fron cell ji in the next time period. 

OWesriON: Is there a "search" of «he cells in J of 
Vengtn T having a total probability of non-detection no more 
than B such that each jt+1 is an elament of I(jt)? The prob- 
ability of non-det2ction is 


Pnd=PoeSTieTeST2eTeST3 ele... oSTmaxe | (A.1) 
Given the abeve problea dJafinition, what non- 


deterministic algorithm will solve it in polynomial time? A 
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non-deter@inastic algorithm is o2n-2 Meet cOitaens <wo 
stages; a guessing stage which sinply guesses an arbitrary 
s2arch j1,j2,...,jf and a pclynomial time "checker" which 
answers the question, “does the arbitrary search have a 
non-detection probability less than B?" It will suffice to 
show that the "checker" will stop in polynomial time and 
answer the question, yes or no. 

The "checker" merely calculates the probability of nor- 
detection using equation A.1 and compares the result with B. 
The calculation entails (T-1)#(Tefl) +1 matrix multiplica- 
tions each of which requires NXN multiplications. Therefore, 
the calculation will require O(TeTleN2) time +o complete. 
The input to the problem has length O(N2+log(T)+tlog(T1l)) (XN 
elements of PO, N2# elements of Tij, at most N2 eslements of 
I(ji), WN elements of the guessed s2arch and «he values of T 
and TDs ) TET amd Tl are restricted to be less “*han of 
egual to some specified polynemial functicn of N, P(N), then 
the input becomes O(P(N) eN2) ani the calculation times 
becomes O(P(N) 2eN2), botm of which are “"potynomial in “N. 
Therefore the "checker" will answer the question in polyno-" 
mMial tim2 based on the length of the input. Based on the 
ageove, che wake search problem is in NP. If the restriction 
on the size of T and Tl are removed the problem may not be 
in NP, i.e. the problem may be NP-Hard. 

Once it has been shown that a given problem is in NP, 1+ 
ts of interest to see 1f the problen belongs «o the class of 
problems called NP-Ccmplets. This class of problems is known 
t> be the set of the hardest problems in NP. [t is conjec- 
tured that the wake search problem as describad above is no 
easier than the NP-Complete problems, however, a proof is 
Hee a@WVailabie. Following is a partial justification for the 
conjecture. 

Proof that a problem is NP-Complete can be done by 


showing equivalence between the given problem and a problen 
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already shown to be NP-Complet+e. As shown abov:, 2 
restricted version of the wake search problem is in NP. Now 
if it could be shown that ‘the wake search problem is no 
easier than a problem which is NP-Complete «the proof would 
be done. What will be done is to show that a relaxed version 
of the wake search probl2m namely th2 wake ssarch problem 
where the searcher motion is unconstrained is functiorally 
Similar to the knapsack problem whish is NP-Complete. 

The knapsack problem can be stated as follews: 

GIVEN: Finite set 0, for sachu Ua size s(up Zt anda 
value v(u) Z+, and positiv2 integers Band K. 
OURS TEON: Is there a subs2t Uy 2.05 = U Seuch, -2ha- 

s(u)<B and such that 2% v(ui 2K? 
ueU* 


The unconstrained searcher problam can be stated as 


2 
ucU ! 


EOlloms: 

GIVEN: a finite set JxTmax, a finite set T, a finite set 
Po, for each jt JI a size s(ji)=1 and a value v(ji)=Pnd, and 
a positive integer Tmax and a ration2l number KS§1. 

QUESTION: Is there a search J={j1,...,jTmax} a subset of 
JxTmax, such that each element ji of J is an slement+ of the 
disjoint subsat JI where the subsets JI form a2 partition of 
JxTmax and such that 2s $(ji)=Tmax and such that equation 
Atl <K? 


While there appears to be significant differences 


between the wake search problem and the knapsack problen, 
there is enough similarity that «hs conjectures that the wake 
search preblen is a+ least as hard as the knapsack problem 
is reasonably justified. Since tha wake search problen as 
compared to the knapsack problem is the unconstrained 
version i+ also appears that the constrained wake search is 
also at least as hard. 

It has been shown that a restricted version of thse 
constrained wake search problem is in NP. It can be hypoth- 
esized that if the restriction (that TI and [fl be polynemiai 
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GRAPHICAL COMPARISON OF ALSORITHM RUNTIMES 


MiaS appendix contains graphs of the runtimes of the 
algorithms for the following cases: 
1. 4 cell grid, T1l=0, and Tmax=1,10 
Secet Grd, Ti=1, and Tmax=1, 10 
4 cell qrid, Tl=2, and Tmax=1, 10 
fee? cell grid, Tl=0, and Tmax=1, 10 
3 9 cell grid, Tl=1, and Tmax=1, 10 
Ge 9 Cell grid, Tl=2, and Twax=1, 19 
7. 116 cell grid, T1=0, and Tmax=1,10 
8. 16 cell grid, Tl=1, and Tmax=1,10 
wav cell grid, Tl=2, and *Teax=1,10 
ieee Cell gerd, Ti=0, and Tmax=1,10 
inemecoecol, grid, Tl=1, and Tmax=1,10 
ieee s Coll qeid, Tl=2, and Tmax=1,10 
Fach graph contains the runtimes for each of tha seven algo- 


rithms, with the following symbols representing each algo- 


ec w 2 

- - Depth-First Strategy, myopi> starting solution 
KE = Depth-First Strategy, tandom starting solution 
+ - Depth-Pirst Strategy, restart algorithn 

X - Best-First Strategy, myopic starting solution 
(wee oer -rirS: Strategy, random stareing solution 
A - Best-First Strategy, restart algorithm 

Oo - Total Enumeration 
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Figure B.6 
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